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Abstract 

Stemmed from the derivation of the optimal control to a stochastic linear- 
quadratic control problem with Markov jumps, we study one kind of back- 
^ ; ward stochastic differential equations (BSDEs) that the generator / is af- 

fected by a Markovian switching. Then, the case that the Markov chain is 
involved in a large state space is considered. Following the classical approach, 
a hierarchical approach is adopted to reduce the complexity and a singularly 
perturbed Markov chain is involved. We will study the asymptotic property 
\ of BSDE with the singularly perturbed Markov chain. At last, as an appli- 

cation of our theoretical result, we show the homogenization of one system 
■ of partial differential equations (PDEs) with a singularly perturbed Markov 

! chain. 
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1. Introduction 



The study of backward stochastic differential equations (BSDEs in short) 
stemmed from stochastic control problem (Q) in which a non- linear Ricatti 
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BSDE was introduced. Then, after the pioneering work of Pardoux and Peng 
((l7j) about the general BSDE which was driven by a Brownian motion, 
BSDEs have been extensively studied in the last twenty years because of 
their connections with mathematical finance, stochastic control, and partial 
differential equations (PDEs in short), please refer to [lo|, 0, 0]- Since then, 
many researchers devoted their work to more general BSDE, such as BSDE 
driven by a Levy process ((l. 15]) and BSDE with respect to both a Brownian 
motion and a Poisson random measure (0, 21, lH). Recently, Cohen and 
Elliott p, 0] studied BSDE driven by the martingale part of a Markov chain 
and its application in finance. 

As studied in Zhang and Yin ([25]), we consider the stocks investment 
models by virtue of hybrid geometric Brownian motion in which both the 
expected return and volatility depend on a finite state Markov chain. To 
capture the market trends as well as the various economic factors, a finite 
state Markov chain at, t > 0, is introduced to represent the general market 
directions. If our object is to allocate assets into a number of stocks so as 
to maximize an expected utility within a finite time horizon, it leads to an 
optimal control problem. By virtue of maximum principle method, we need 
to introduce an adjoint equation to deal with this optimization problem. The 
adjoint equation and the state equation form forward backward stochastic 
differential equations (FBSDEs in short) system. Here the adjoint equation 
will be a kind of BSDE with a Markov chain. 

Motivated by such adjoint equation, in our paper, we consider the follow- 
ing BSDE with a Markov chain: 



Y t = C+ f f(s,Y s ,Z s ,a s )ds- f Z t 
Jt Jt 



dB 



s ■ 



where a = {a t ; < t < T} is a continuous-time Markov chain independent 
of the Brownian motion B. It is noted that this BSDE is different from the 
one studied in Cohen and Elliott (pi]), and it can be considered as that its 
generator is disturbed by random environment and takes a set of discrete 
values which can be described by a Markov chain. 

When study the solvability for BSDE with a Markov chain, the classic 
method with the contraction mapping cannot be directly used for the lack 
of suitable filtration and corresponding Ito's representation theorem. In this 
paper, inspired by the method dealing with the BSDE with doubly Brown- 
ian motion ([l9j]), we construct a new filtration and give the corresponding 
extended Ito's representation theorem. 
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When various factors are considered, the underlying Markov chain in- 
evitably has a large state space, and the corresponding BSDE becomes in- 
creasingly complicated. It is rationale that the change rates of states display 
a two-time-scale behavior, a fast-time scale and a slow varying one. Under 
this small parameter e > can be introduced and the singularly 

perturbed Markov chain is involved. 

In this paper, we consider the case that the states of the underlying 
Markov chain are divided into a number of weakly irreducible classes such 
that the Markov chain fluctuates rapidly among different states, and jumps 
less frequently among those classes. To reduce the complexity, a small pa- 
rameter (e > 0) is introduced to reflect the different rate of changes among 
different states. As shown in Zhang and Yin (j23|), it leads to a singularly 
perturbed Markovian models with two-time scale, the actual time t and the 
stretched time -. By aggregating the states in each irreducible class into a 
single, a limit aggregated Markov chain with a considerably smaller space 
can be obtained and its asymptotic probability distribution is studied. Such 
asymptotic theory has many applications in optimal control problem and 



mathematical finance. We refer interested readers to |25l . 124 . 

In this paper, we will focus on the asymptotic property of BSDE with a 
singularly perturbed Markov chain. Following the averaged approach that 
aggregating the states according to their jump rates, we will show that the 
distribution of (Y t , J. Z s dB s ) can be seen as an asymptotic distribution to 

(Y t e , / T Z e a dB 8 ), where (Y £ ,Z £ ) and (Y, Z) satisfy: 



Y t e = £ + jT f(s,Y a e ,cf a )ds- jf Z t 



and 

rT 



s dB s 



Y t = Z + j t f(s,Y s ,a s )ds- J Z s dB s . 

Here a and f(s,Y s ,a s ) are respectively the limit aggregated Markov chain 
and the averaged generator with respect to the quasi stationary distributions 
of the singularly perturbed Markov chain. Compared to the original BSDE 
with the singularly perturbed Markov chain, the limit BSDE depends on 
a Markov chain with a much smaller state space. Thus the complexity is 
reduced. 

It is well known that BSDEs provide a probabilistic representation for 
the solution of a large class of quasi-linear second order partial differential 
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equations (PDEs in short) (0, M, M, 0, Q)- Thus BSDEs provide a 
probabilistic tool to study the homogenization of PDEs, which is the process 
of replacing rapidly varying coefficients by new ones thus the solutions are 
close. In this paper, as an application of our theoretical result, after showing 
the relation between our BSDE and one system of semi-linear PDE, we will 
show the homogenization result of one system of semi-linear PDE with a 
singularly perturbed Markov chain. 

This paper is organized as following. In section [2j we study the solvability 
of BSDE with a Markov chain. Section [3] is devoted to the case that Markov 
chain has a large space. Under Jakubowski S-topology (0] ) which is weaker 
than Skorohod's topology, we present the asymptotic property of BSDE with 
a singularly perturbed Markov chain. In section HJ we show the application 
of our theoretical results in the homogenization of one system of semi-linear 
PDE with a singularly perturbed Markov chain. For the terseness of the 
main text of our paper, we put part of technical proofs for some results in 
Appendix. 

2. BSDEs with Markov Chains 

Let (Q, J 7 , P) be a probability space and T > be fixed. {H t , < t < T} 
is a filtration on the space satisfying the usual condition. B = {B t ; < 
t < T} with Bq = is a d- dimensional "H t -Brownian motion, and a = 
{ott'i < t < T} is a continuous-time Markov chain independent of B with 
the state space M. = {1,2, .. . , m}. Suppose the generator of the Markov 
chain Q = {q^) 

mxrn 

is given by 



P{a(t + A) =j\a(t) = i] 



qij A + o(A), Mi 
l + g ij A + o(A), if z = j 



where A > 0. Here > is the transition rate from i to j if i ^ j, while 

Em 
j=i,i^j qij- 

Throughout this paper, we introduce the following notations: | • | is the 
norm in the corresponding space; A' is the transpose of matrix A; L p ("H t ; R n ) 
is the space of ^""-valued % t -adapted random variable £ satisfying E(\^\ p ) < 
oo; M^ t (0,T; R n ) denotes the space of R n - valued ^-adapted stochastic 

processes (p = {(fit',t G [0, T]} satisfying E \(p t \ 2 dt < oo; Sy^ t (0,T; R n ) 
is the space of i? n -valued % t -adapted continuous stochastic processes = 
{cp t ;t e [0,T]} satisfying £(sup 0<t<T \ip t \ 2 ) < oo. 



4 



2.1. Motivation 

To study the stochastic optimal control problem with a Markov chain, we 
introduce an adjoint equation, then the state equation and adjoint equation 
form a kind of FBSDEs with a Markov chain. Here the adjoint equation will 
be a BSDE with Markov chain. We give the following linear quadratic (LQ 
in short) optimal control problem as an example. 

Consider the following stochastic LQ control problem with Markov jumps 



min. J(v) = -e( f ((x v t )'R(t, a t )x v t + v' t N(t, a t )v t ) dt + (x v T )'Q{a T )x 
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o 



s. t. 



TJ 

(la) 

dx v t = (A(t, a t )x v t + B(t, a t )v t ) dt + (C(t, a t )x v t + D(t, a t )v t ) dB t 
x v = ae R n 

(lb) 



where A(t,a t ) = A^t), B(t,a t ) = B { {t), C{t, a t ) = C^t), D{t, a t ) = D { {t), 
R(t,a t ) = Ri(t), N(t, a t ) = Ni(t) when a t — i (i — 1, • • ■ ,m), and they 
are uniformly bounded J-" t B -adapted processes with appropriate dimensions. 
Q(ctx) = Qi when a T = i (i — 1, • • • , m), and it is nonnegative symmetric 
matrices- valued J-"|?-measurable random variable. Besides, Ri(t) is nonnega- 
tive symmetric matrices- valued, Ni(t) is positive symmetric matrices- valued 
and the inverse A^(t) -1 is bounded. The set of all % t -adapted admissible 
controls is U a d = M^ t (0,T; R UuXd ), and our aim is to find an admissible 
control u such that J{u) = inf J(v). 

v£U ad 

There are many literatures on this kind of LQ optimal control problem 



with Markov jumps ([T]) and its application, such as [26|, [12|, |24| and their 
references. Different to their methods that constructing the optimal control 
via the solution of Riccati equation, we will use the FBSDEs approach. 

Theorem 2.1. // the following FBSDE admits a unique solution (x t , yt, z t ) 

dx t = (A(t, a t )x t + B{t, a t ) {-N~ l (t, a t ) (B'(t, a t )y t + D'{t, a t )z t ))) dt 
+ (C(t, a t )x t + D(t, a t ) (-N-\t, a t ) (B'(t, a t )y t + D'(t, a t )z t ))) dB t , 
-dy t = (A'(t, a t )y t + C'(t, a t )z t + R(t, a t )x t ) dt - z t dB t , 
xo = a, Vt = Q{a T )x T . 

(2) 
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Then 

u t = -N~% a t ) (B'(t, a t )y t + D'(t, a t )z t ) ,0<t<T 
is the unique optimal control for the LQ problem ([T]) 

Proof. Firstly, we will prove that {u = u t ; < t < T} is an optimal control 
for the LQ problem ([T]). 

From the forward equation of ([2]), we can see that x is the corresponding 
system state trajectory of u. For an arbitrary admissible control v, denote 
x" as the corresponding system state trajectory, then 

J(v) - J(u) 

i / r T 

= -EU ((x v t - x t )'R(t, a t )(x v t - x t ) + (v t - u t )'N(t, a t )(v t - u t ) 
+ 2x' t R(t, a t )(x v t - x t ) + 2u' t N(t, a t )(v t - u t ))dt 
+ {x v T - x T )'Q{a T ){x v T - x T ) + 2x' T Q{a T ){x v T - x T )^j . 

Applying Ito's formula to y' t {x v t — Xt), we have 

Ex' t Q(q:t)(xt — xt) 

=E [ ( {y' t B{t, a t ) + z' t D{t, a t )) {v t + N^(t, a t ) {B'{t, a t )y t + D\t, a t )z t )) 
Jo 

— x' t R(t, a t )(x v t — xt))dt 

=E / ((y' t B(t, a t ) + z' t D(t, a t )) (v t - u t ) - x' t R(t, a t )(x v t - x t )) dt. 
Jo 

As R, Q are nonnegative and iV is positive, we have 

J(v) - J{u) >E [ (y' t B(t, a t ) + z' t D(t, a t ) + u' t N(t, a t )) (v t - u t )dt 
Jo 

=0. 

So u{t) = — A r ~ 1 (t, a t ) (B'(t, a t )yt + D'(t, a t )z t ) is an optimal control. 

Uniqueness: Assume that u 1 and u 2 are both optimal controls with 
J{u l ) = J{u 2 ) = 7 > 0, and the corresponding trajectories are x 1 and x 2 . 
Due to the linear property of the system, the trajectories corresponding to 
u 1 + u 2 x l + x 2 
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From the classical parallelogram rule, R, Q are nonnegative, and N is 
positive, there exists 5 > such that 

27 

= J(u v ) + J{u 2 ) 



2 j \\ 2 / V 2 j Jo w 2 

R(t,* t ) (^=^) + (^^)'iV(t,a,) ) )d£ 

1 1 2 \ / I 2 \ ' /I 2 



>2J(^— )+£/ 1-hH-) JV(t, a t ) ( -hH- ) dt 



(5 /*T 



Thus E J T — u 2 \ 2 dt < which yields that u l = u 2 . □ 

BSDEs with Markov chains 

The derivation of the optimal control for the above LQ problem ([1]) can 
be regarded as one motivation for us to study BSDEs with Markov jumps. 
In this subsection, we will study the solvability to the following BSDE with 
a Markov chain firstly: 

Y t = Z + l f(s,Y s ,Z s ,a s )ds- J Z s dB s . (3) 

Let J\f denote the class of all P-null sets of T. For each t G [0, T], we 
define T t = Tf V V M where for any process {rjt',0 < t < T}, T"^ T = 
o~{Vr] t < r < T} and = T§ t . For convenience, we denote M 2 (0, T; R n ) = 
AfJ. t (0,T;iT) and S 2 (0,T; R n ) = 5^(0, T;R n ). 

Thereinafter, we make the following assumption: 

Assumption 2.1. (i) £ G L 2 {T T \ R k ); (%%) f : O x [0, T}xR k x R kxd xM-f 
R k satisfies thatV(y,z) G R k x i? fcxd ; Vi e M, f(-,y,z,i) G Mi B (0,T; R k ), 

and 3/j, > 0, such that Vi G .M, V(w,t) G fi x [0,T], (2/2,^2) G 

i? fc x # fcxd , 

- f{t,y 2} z 2} i)\ < fi(\yi - y 2 \ + \zi - Z2I). 
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Our main result in this section is in the following theorem. 

Theorem 2.2. Under Assumption \2.1\ there exists a unique solution pair 
(Y,Z) G S 2 (0,T; R k ) x M 2 (0,T; R kxd ) for BSDE ©. 

The proof of Theorem 12.21 consists of three steps. 
Step 1: Extension of Ito's representation theorem 

It is noted that {J^; < t < T} is neither increasing nor decreasing, 
and it does not constitute a filtration. Inspired by the method handling the 
BSDE with doubly Brown motions ([l^]), we define a filtration (Qt)o<t<T by 

Q t A jrB v j-a v ^ 

For the filtration (Qt)o<t<T, we give the following extension of Ito's represen- 
tation theorem. This result and its corollary play key roles during the proof 
of Theorem 12.21 

Proposition 2.1. For N G L 2 (Qt] R k ), there exist a unique random variable 
N G L 2 {J r ^;R k ) and a unique stochastic process Z = {Z t ;0 < t < T} G 
Ml(0,T;R kxd ) such that 

N = N + [ Z t dB t , 0<t<T. (4) 
Jo 

Actually, N = E(N\F%). 

During the derivation of Proposition 12.11 we need the following two lem- 
mas. 

Lemma 2.1. ([22]) If X, Y: f2 — > R d are two given functions, Y is cr(X)- 
measurable if and only if there exists a Borel measurable function g: R d —> R d 
such that Y = g{X). 

Lemma 2.2. (Doob's martingale convergence theorem) Let £ > 0} be a 
filtration on the space (fi, J 7 , P), X G L 1 (J r ;i? d ) ; then 

E(X\J r t ) — > E(X\J r 00 ), as t —)• oo, a.s. and in L 1 as well. 

Proof. Existence: Let {ti}«>o, {t'j}j>o be two dense subsets of [0, T] where 
^o = ^o = 0. For each integer n, m > 0, let G n ,m be the cr-algebra generated by 
ct to ,Q. tl ,- ■ ■ ,a tn , B t > o , B t ' v ■■■ , B t > m , i.e., G n ,m = a{a to , a tl , ■ ■ ■ , a tn , B t > o , B^ , 
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''■ l^frnJ 1 Obviously, Q n ,m C G n +l,m, Gn,m C {?n,m+l> £n,m C (? n +l,m+l; 
^(U~ =1 ^ n ,m) = ^"t V ^{"tojOtu - ' ' > and cr ( U ^m=0 ^n,m) = Gt- 

For iV G L 2 (Qt] R k ), Vn, m, by Lemma [2.11 and Lemma [2.2[ there exists 
a Borel measurable function N n>m : M n+1 x #( m +i) xd _ ^ suc h that 

£(iV|£/ nj7n ) = N nim (a to , a h , ■ ■ ■ , a tn ,B t ^B t ^- ■ ■ , B t /J 

Nn,m(ato 5 atu" • ,a tn ,B t ^B t ^ - ■ ■ ,B t , m ) -> £ (iV|J*y V <x{a to , a tl , • • ■ ,«*„}) 

Denote N n (a to , a tl , ■ ■ ■ ,a tn ) = E {N\T^ V a{a to , a tl , • • • ,a tn }), it can be 
rewritten as 

N n (a to ,a tl , ■ ■ ■ ,a tn )= 2J ^{(oto.ot!,-,^)^^,-,?™)}^^, • • • ,«n) 

io,ii,-" ,«n=l 

where N n (i , i\, • • • , i n ) is J 7 ^ -measurable. 

For (z , • • • ,i n ) G .M n+1 , applying Ito's representation theorem, 

N n (i ,ii, ■ • • ,i n ) = N {io,h, • • • ,i n ) + / Z t (i ,ii, ■ • • ,i n )dB t 

Jo 

where N (i , i\, ■ ■ ■ , i n ) is a constant and Z(i , • • • , z n ) G Mj. s (0, T; R kxd ). 
Denote 

iV (Q! to ,at 13 • • • ,a tn ) = ^{( a i , a i 1 ,-,ai n )=(i ,u,-,in)}^ r o(«o,«i, • • • ,*n), 

»Oi*l)"' i*n=l 
m 

and^ t (at ,a tl ,--- ,a tn )= 2J I{(a to ,a tl ,-m„)=(io,ii,-,in)} z t{io, h, • • • An)- 

Clearly, iV (a io , a tl ,-- >®t n ) e L 2 (F^R k ), {Z t (a to , a h ,--- ,a tn );0 < t < 
T} G M|(0, T; i? fcxd ), and we have 

iV" n (o!t ,a! tl , ••• ,aO = A^a^a^, ••• ,a t J + / Z t (a to ,a tl , - ■ ■ ,a tn )dB t . (5) 

In the remained part, we will prove that as n — > 00, both side of (JSJ) are 
Cauchy sequences. 

For the left hand side, as n — >■ 00, with the definition of iV n (a to , a tl , • ■ • , a tn ) 
and Lemma I2.2[ we have 

N n (a to ,a tl , ■ ■ ■ ,a tn ) -> N. 
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For the right hand side, since 

i ,h,- ,i n =l ^ Jo ' 

= 0. (6) 

Thus N (a to ,a tl ,- ■■ ,a tn ) = E(N n (a to , a tl , • • ■ ,oOI^t)- As n ^ oo, we 
can conclude that 

N (a t0 ,a tl ,--- ,a tn )^ E{N\J%). 

Now let us consider the sequence {Z t (a to , a tl , • ■ • , a tn ); < t < T}. For 
n, m > 0, 

f T 2 
E / \Z t (a t0 ,a tl , - ■ ■ ,a tn ) - Z t (a to ,a tl ,- ■ ■ ,a tm )\ 2 dt 

Jo 

= E[ (Z t (a to ,a tl , - ■• ,a tn ) - Z t (a to ,a tl ,- ■ ■ ,a tm ))dB t 



= E(E(N\F*Va{a t0 ,a tl ,--- , a tn }) - E (N\tf V a{a to , a h , ■ ■ ■ , a tm }) 

- N (a to ,a tl , ■ ■ ■ ,a tn ) + N (a to , a tl , ■ ■ ■ ,a tm )) 

< 2E(E{N\JF* Va{a t0 ,a tl ,--- , a tn }) 2 - E{N\rf V a{a to ,a tl , ■ ■ ■ ,a tm })) 2 

+ 2E(N Q (a t0 ,a tl ,- ■ ■ ,a tn ) - N (a to , a tl , ■ ■ ■ ,a tm )) 2 
— > 0, as n, m — > oo. 

Thus {Z t (a to , a tl , ■ ■ • , a tn ); < t < T} is a Cauchy sequence in Mg t (0, T; 
R kxd ). Hence it converges to some Z e Mg t (0,T; R kxd ). 

Denote No = E^N]^), we can conclude that ([5]) converges to the ex- 
tended Ito's representation (J4]). 

Uniqueness: By virtue of equation fl6]) and the fact that as n — > oo, 
{Z t (a to , a^, - ■ ■ ) a t n )', < t < T} is a Cauchy sequence, we have E(J^ ZtdB^T^) 
= 0. Then, for (N , Z), (Nq, Z 1 ) satisfying the extended Ito's representation 
01]), we get Nq = Nq by taking conditional expectation with respect to J 7 ^. 
Uniqueness of Z follows easily from the fact that 

E j \Z t -Z' t \ 2 dt = E^ (Z t -Z' t )dB t \ = E{N -N^) 2 = 0. 
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The following corollary is useful in the proof of Theorem 12 . 2 1 and its proof 
is similar to Proposition 12.11 

Corollary 2.1. For t < T , we consider the filtration (J\f s )t< s <T defined by 
M B = Tf VF? T . ForN G L 2 (Af T ; R k ), there exists a unique stochastic process 
Z = {Z s - t<'s<T} e M%f s (t, T; R kxd ) such that 

N = E(N\M t ) + J Z s dB s . 

Step 2: The special case: the generator / is independent of y and 

z. 

Proposition 2.2. Under Assumption \2.1l the following BSDE 

F * = £ + / f(s,a 8 )d8-J Z s dB s , 0<t<T (7) 

has a solution pair (Y, Z) G S 2 (0,T;R k ) x M 2 (0,T; R kxd ). 
Proof. From Assumption 12.11 and Holder inequality, we obtain 

/ pT \ 2 pT m pT 

E^ f(s,a s )dsj <CEj^ \f{s,a s )\ 2 ds<Cj2 E J q \f(s,i)\ 2 ds < oo 



which yields 

rT 



/ f(s,a s )dseL 2 (g T ;R k ' 
Jo 

For the filtration (G t ) <t<T where Q t = Tf V J% V N = Tf V J 7 ^ V T% V 
J\f = JjV J 7 ", we can define the following (^-measurable square integrable 
martingale 

N t = E (t + J f{s,a s )ds\g^ , 0<t<T. 

By the extended Ito's representation theorem (Proposition 12.11) . there exist 
N G L 2 (^; R k ) and Z = {Z t ; < t < T} G M|(0, T; # fcxd ) such that 

N t = N n + ! Z s dB s , 0<t<T. 
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For t E [0, T], we define 

Y t = N *-J Q f( s > a ^ ds > Le -> Yt = E (^ + i a *) ds l&) • ^ 

It is easy to verify that the ^-measurable process (Y. Z) satisfies BSDE ([7]) 
and Y E Mg t (0, T; R k ). We refer interested reader to |l7|, [l6( for the detailed 
verification. 

The left work is to show that the processes Y = {Y t ; < t < T} and Z = 
{Zt',0 < t < T} are J^-measurable, i.e. Tf V J-^-measurable. Wt E [0, T], 

we denote $ = £ + f(s,a s )ds, $ is V J 7 ^- measurable. 

Let {ti}i>o, {^j}j>o be respectively dense subsets of [t,T] and [0,T], with 
i = t and £q = 0. For each integer n, m > 0, let C? njjn be the a-algebra gen- 
erated by a>i , ttfj , • • ■ , OLi n , £^ , , • ■ • ,Bp m , i.e., C? n ^ m = cr{aj , a fl , • -_• , a fn , 

Bp Q , Bp ± , ■ ■ ■ ,Bp m }. Obviously, Gn,m C £ n +l,m+l> Gn,m C Gn+l,mi Gn,m C 

G n ,m+i, and cr(U^ m=0 G n , m ) = Fr y Ft,T- 

From Lemma r2.lt for each n, m, there exists a Borel measurable function 

$nm ■ M n+l X R{™+l)xd R k guch that 

E[$\G n ,m] = ^nm(«f , ®h > " ' " > tt ?n > > ^ , " " ' > 5 c) • 

Since I{(a fo ,a fl> - iafn )=(i 0l n,-,i™)} e -7^ C J?, we have 

E (0 nm K,Ofi, • • • , at n ,B Po ,B Pi ,- ■ • , BjJlJf V 7?) 

(m 
^{( Q t . a i 1 :---,Q!t n ) = («0,«lr--,jn)} 
i0,»l,"' ,«n = l 

^nm(«0,«l! • ■ ■ ,*n, Bp Q , B? i , ■ ■ • , Bp^jf V J 7 ^ 
m 

= ^{(«f ■£>?!.••• ,a fn )=(io,H,- ,*n)} 

iOiW:'" ,in=l 

E(ti nm (i ,ii,--- ,i n ,Bp o ,B {[ ,--- ,B P J\F t B VF2). 

For the reason that $ nm (io, *i> • " , in, Bp o , Bp^ , • • • , Bp m ) is J-'y-measurable, 
by Ito's representation theorem, we know that there exist VQ' m (i , Zi, • • • , i n ) 
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G R k and Z n > m (i , i u ■ ■ ■ , i n ) 6 L 2 (0, T; i? fcxd ) such that 

£ (#nm(*o, %u ■ ■ • , «n, £f >£*1, • • • , V 7?) 

=E(v£ m (i ,i 1 ,--- ,in) + J Q Z? m (i ,i 1: --- ,i n )dB r \T t B VJ%) 

="o ,m (io, ii, • • • , in) + / ^ r n ' m (io, ii, - • • , in)d5 r 

Jo 

is J-^-measurable. Therefore 

£ (i m («t. , a k , ■ ■ ■ , a ln , B ¥q , B Pl , ■ ■ ■ , B P J\T t B V J?) 

= ^{( Q t ,at n )=(*0,n,--- ,*n)} 

-E" (l?nm(iO) ii, • " - ; in, Bp o , Bf^ • • • , Sf> m )| J* t V J'y) 

is J 7 ^ V J-^-measurable. With Lemma [2.21 as n, m — > oo, 

Thus E[&\Ff V 75?], i.e., K t , is also Tf V ^-measurable. 
Considering 

J Z s dB s = -Y t + £ + J f(s,a s )ds, 

its right side is J- B V J-^-measurable. With Corollary 12.11 we know Vi < s, 
Z s is T B V J-"" T -measurable. Then, by the continuous property of the Markov 
chain a, we obtain that Z s is Tf V 7f T -measurable. 

Together with the Burkholder-Davis-Gundy inequality and the form of 
BSDE ([7]), we can conclude that {Y t ; < t < T} is continuous and satisfies 
E( sup \Y t \ 2 ) < 00. It yields that Y E S 2 (0,T; R k ). □ 

0<*<T 

Step 3: The general case: Proof of Theorem 12.21 

Proof. Firstly, we define a mapping / from M 2 (0,T; R k x R kxd ) into itself 
such that (y, Z) G S 2 (0, T; # fc ) x M 2 (0, T; R kxd ) is the solution to BSDE flUJ 
iff it is a fixed point of /. 
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For a constant f3 > 0, we introduce the following equivalent norm of 
M 2 (0,T; R k x R kxd ) 



v(.)\\p=[E \v s \^ s ds 



T \ 2 



For (y, z) G M 2 (0, T; i? fe x R kxd ), we set 



Y t = £ + j f(s,y s ,z s ,a s )ds- J Z s dB s . 
From Assumption 12.11 and Holder's inequality, 



E 



f(s,y s ,z s ,a s )ds 



< 2 #(jf (/(s,y a ,z a ,a s )-/(s,0,0,a«))ds^ +2E (f /(s ' ° ! °' 
(|2/ a | 2 + |^ s | 2 )ds + V# / UM,(M)| 2 ds <oo 

<=1 / 



<C\E 



which yields that 



C+ / f(s,y s ,z s ,a s )dse L 2 (Q T -R k 



From Proposition ^. 2[ we can define the following contraction mapping under 
the norm || • \\p 

J(( y , z )) = (Y, Z) : M 2 (0, T; R k x # fexd ) -)■ M 2 (0, T; # fc x i? fcxd ). 

The proof of contraction property is similar to 17, lo[ 16|. For the compact- 
ness of the paper, the detail is omit here. 

Together with the form of BSDE ([3]) and Burkholder-Davis-Gundy in- 
equality, Y € S 2 (0,T; R k ). Thus, by the fixed point theorem, we know that 
BSDE (J3J) has a unique solution pair. □ 
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3. BSDEs with Singularly Perturbed Markov Chains 

In this section, after recalling several relevant results of singularly per- 
turbed Markov chains given by Zhang and Yin ([23]), we will consider the 
asymptotic property of BSDE with a singularly perturbed Markov chain. 
Following the averaging approach to aggregate the states according to their 
jump rates and replace the actual coefficient with its average with respect to 
the quasi stationary distributions of the singularly perturbed Markov chain, 
we get the asymptotic probability distribution of the solution to the BSDE 
with an limit averaged Markov chain which has a much smaller state space 
than the original one. 

3.1. Relevant results of singularly perturbed Markov chains 

Focused on a continuous-time ^-dependent singularly perturbed Markov 
chain a £ = {af ; < t < T} which have the generator Q £ = —Q + Q, where 

Q and Q are time-invariant generators, with Q = diag(Q 1 ,-'' ,Q 1 )- The 
state space can be decomposed as M. = {1, 2, ■ ■ • , m} = M. 1 U • • ■ U Aii, 
■Mk = { s m, ■ ■ ■ , s km k }, and for k G {1, • • • , /}, Q k is the weakly irreducible 
generatocl corresponding to the states in M. k . The generator Q dictates the 
fast motion of the Markov chain and Q governs the slow motion, i.e., the 
underlying Markov chain fluctuates rapidly in a single group Ai k and jumps 
less frequently among groups M.^ and M.^ for k ^ j. 

As shown in [23j|, when the states in M.^ are lumped into a single state, 
all such states are coupled by Q. By defining a £ = k, when a\ G Aik, we 
can obtain the aggregated process a 8 = {af ; < t < T} containing / states. 
The process a 6 is not necessarily Markovian, but it converges weakly to a 
continuous-time Markov chain a. 

Proposition 3.1. ([25]) (i) a £ converges weakly to a generated by 

Q = diag{v l , ■ ■■ , u l )Qdiag(J mi , ■ ■ ■ ,I m J 

as e — > 0, where v k is the quasi- stationary distribution of Q k , k = 1, ■ ■ ■ ,1, 
andl k = (!,■■• ,1)' G R k . 



3 A generator Q is called weakly irreducible if the system of equations vQ = 
and Vi = 1 has a unique nonnegative solution. This nonnegative solution v = 

(yi, • • • , v m ) is called the quasi-stationary distribution of Q. 



15 



(ii) For any bounded deterministic function /?(•), 

e(J (I {af=Sk . } -pfl M=k} )^(t)d?j =0(e),VA; = l,-.-,Z,Vj = l,---,m fc . 
i/ere zs £/ie indicator function of a set A. 

3.2. Weak convergence of BSDEs with singularly perturbed Markov chains 

In this subsection, denote D(0,T] R k ) as the Skorohod space of cadlag 
trajectories endowed with the Jakubowski S-topology ((§]) which is weaker 
than the Skorohod topology. As shown in the appendix of 0], the tightness 
criteria under this S-topology is the same as the "Meyer-Zheng tightness 
criteria" used in 14 



Here, we only consider the asymptotic property of the solution to the fol- 
lowing BSDE with a singularly perturbed Markov chain where the generator 
/ does not depend on Z e , 



Y t e = £ + J' f{s, Yg, a s )ds - ^ Z £ s dB s , (9) 

For the difficulty to study the general case that the generator / depends on 
Z e , we refer interested reader to the explanation in section 6 of 16l . 
Firstly, we make the following assumption: 

Assumption 3.1. (%) i G L 2 {T^\ R k ). (ii) For f : [0, T] x R k x M -»■ R k , 

there exists a constant C > such that sup \f(t, 0, i)| < C. 



0<t<T 
Ki<m 



Theorem 3.1. Under Assumption \2.1\ and Assumption \3.1\ the sequence of 
process (Y t £ , J Q * Z £ s dB s ) converges in distribution to the process (Y t , J Q * Z s dB s ) 
as e — > 0, when probability measures on D(0, T; R 2k ) equipped with the Jakubowski 
S-topology. Here (Y, Z) is the solution pair to the following BSDE with the 
limit averaged Markov chain 



Y t = Z + J t f{s,Y s ,a s )ds- J Z s dB s , (10) 
B = {B t ; < t < T} with Bq = is a d-dimensional Brownian motion, a 

rrii 

is defined in subsection \3.1\ and f(s,y,i) = v }f{^-> Vi s %j) f or i ^ M. = 
{!,-■• ,0- 
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Remark 3.1. It is obvious that the limit BSDE depends on the limit av- 
eraged Markov chain a with a state space much smaller than that of the 
original singularly perturbed Markov chain a £ . Moreover, as e — > 0, the T^f - 
measurable random variables sequence (y o e ) converges in distribution to the 
random variable Y which is ^-measurable. 



For the proof of Theorem I3.1[ we follow a classical approach as in |20l . |2| 
to prove the weak convergence of BSDE: after showing the tightness and 
convergence for (Y t £ , J * Z £ dB s ), we identify the limit. 
Step 1: Tightness and convergence for (Y t £ , J* Z £ s dB s ). 

Proposition 3.2. Under Assumption \2.1\ and Assumption \3.1\ BSDE (TJ| 
and BSDE flU have unique solutions (Y £ ,Z £ ) and (Y, Z) e S 2 (0,T;R k ) 
xM 2 (0, T; R hxd ). Moreover, there exists a positive constant C such that 
\/e > 0, 

T 



E ( sup \Y £ \ 2 + [ (Z £ ) 2 dt) < C 

\0<t<T Jo J 



T 

2, 



E[ sup \Y t \ 2 + I (Z t ) 2 dt) <C. 

yO<t<T 



Proof. For BSDE (J9J), by Theorem 12 .2\ the existence and uniqueness of solu- 
tion (Y £ , Z £ ) is obtained for all e > 0. 

Using Ito's formula to \ Y £ \ 2 on [t, T], we get the following from Schwartz's 
inequality, 

\Y £ \ 2 + £ \Z £ s \ 2 ds 

= |e| 2 + 2 [ T Y s £ f(s,Y s £ ,Z £ s ,a s )ds-2 f " Y s £ Z £ s dB s 
Jt Jt 

<|e| 2 + 2 [ T ((l + ^ 2 )\Y s £ \ 2 + \f(s,0,0,a £ s )\ 2 )ds-2 f " Y s £ Z £ dB s 
Jt Jt 

here \i is the Lipschitz constant of / which is independent of e. By taking 
expectation, we can deduce 

E(\Y t £ \ 2 + \ [ T \Z £ s \ 2 ds)<\e + 2 [ T ((l + ^)\Y £ \ 2 + \f(sMal)\ 2 )ds. 
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From Gronwall's lemma, we get 

E (} Y t\ 2 + f \ Z s\ 2ds ) <CE^\ 2 + £\f(s,0,0,al)\ 2 ds^ <C, 

and then the estimation for (Y £ , Z £ ) is obtained from the Burkholder-Davis- 
Gundy inequality. 

From the form of / presented in Theorem 13. 11 we know that / also satisfies 
Assumption 12.11 and Assumption 13.11 thus the estimation about (Y, Z) can 
be obtained similarly. □ 

We set Ml = Z e s dB s for the convenience. Thus BSDE (jHJ) can be 
rewritten as 

Y t=Z + j f{s,Y!,cf s )ds-{M £ T -M$). (11) 

Proposition 3.3. The sequence of (Y e ,M £ ) is tight on the space D(0,T; 
R k ) x D(0,T; R k ). 

Proof. Let Q\ = V T^f V A/", we define the conditional variation 

CVOn = sup£ ^ \E{Yl +i - YRGl^ 

where the supreme is taken over all partitions of the interval [0, T]. 

From the Proof of Proposition 12. 2\ we know that M e is a ^-martingale. 
It follows that 

CV(Y*)<e[ \f(s,Y*,al)\ds. 
Jo 

From (ii) of Assumption I2.1[ (ii) of Assumption I3.1[ and Proposition I3.2[ we 
know 

sup(CV(y £ )+ sup E\Y t £ \+ sup E\M £ t \] < oo. 

e \ 0<t<T 0<t<T J 



Thus the "Meyer-Zheng tightness criteria" ([2|, [14() is fully satisfied and the 
result is followed. □ 

Together with the properties of Y e obtained above, the following propo- 



sition can be seen as an obvious result of Lemma 7.3 in 25 
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Proposition 3.4. Suppose g(t, x) is a function defined on [0, T] x R m satisfy- 
ing that g(-, •) is Lipschitz continuous with x and Wx e R m , either \g(t, x)\ < 
K(l + \x\) or \g(t,x)\ < K. Denote 7iy(t) = 7T?-(t, af), with 7rfj(t,a) = 
I{ a = Sl] } - v]I{ aeMl }, then for any k = 1, - • • , I, j = 1, • • • , m k , 

-t 

->• 0, as e ->■ 0. 



sup £ / ^(t,F/)7T^(s,^)ds 

0<t<T Jo 

Step 2: Identification of the limit. 



From Proposition 13. 3[ we know that there exists a subsequence of (Y £ , M £ ), 
which we still denote by (Y £ ,M £ ), and which converges in distribution on 
the space D(0,T;R k ) x D(0,T;R k ) toward a cadlag process (Y,M). Fur- 
thermore, there exists a countable subset D of [0,T], such that (Y £ ,M £ ) 
converges in finite-distribution to (Y, M) on D c . 

Proposition 3.5. For the limit process (Y,M), we have 

(i) For every t e [0, T] — D, 

Y t = Z + J f(s,Y s ,cx s )ds-(M T -M t ). 

(ii) For a d- dimensional Brownian motion B = {B t ; < t < T} with B = 0, 
Y is measurable with T-L t = Tf V T^, then M is a 7-L t -martingale. 



Proof. From Proposition 13. 4[ as e — > 0, 



sup E 

0<t<T 



[ f(s,Y s £ , SlJ ){l { 
Jo 



Since (Y £ ,a £ ) converge weakly to (Y,a), 

ft pt 
f(s, Y £ , a £ s )ds converges in distribution to / f(s, Y s , a s )ds on C(0, T; R k ) 

Jo 

Thus 

^ f(s,Y s £ ,a £ s )ds 

»t l rrn 



ds 



0. 



■ / ° i=l f=l 



i=i i=i 



^-^{aieMi}) + / f(s,Yf,af a )ds. 
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As e — > 0, passing to the limit in the backward component of the BSDE fllip . 
we can derive assertion (i). 
Now, we prove assertion (ii). 

For any < t\ < t 2 < T, $ tl is a continuous mapping from C(0, tx] R d ) x 
D(0,ti] R k ) x D(0,T; M). We > 0, since M e is a martingale with respect to 
Q\ = V \ Y £ and d £ are ^f-adapted, we know 

E ($ tl (B, Y £ , a £ ) (V/ 2 - Y* + jf" f(s, 17, oflds) ) = 



and 



E U h (B,Y^a s ) j\M £ t2+ r ~ M t s 1+r )dA = 0, 



here B is the Brownian motion. 

From the weak convergence of (Y £ ,a £ ) to (Y,a), f(s,Y £ ,a £ )ds con- 
verges in distribution to f* f(s, Y s , a s )ds on C(0, T; f? fc ). For a d-dimensional 
Brownian motion B = {B t ; < t < T} with B Q = 0, from the fact that B 

has the same probability distribution with B and E( sup |M t £ | 2 ) < C, we 

o<t<r 

obtain 

E ($ tl (B,Y,a) (% 2 -Y tl + f 2 f(s,Y s ,a s )ds)) =0 



fi 



and 

r-<5 



£ Y, a) / (M fe+r - M tl+r )dr = 



o 



Dividing the second identity by 5, letting 5 — > 0, and exploiting the right 
continuity, we obtain that 

E($ tl (B,Y,a)(M ta -M tl ))=0. 

From the freedom choice of ti, t 2 , and <E> tl , we deduce that M is a 
martingale. □ 

Proposition 3.6. Let {(Y t , Z t ); < t < T} be the unique solution of BSDE 
(U2D, thenVt G [0,T], 

E\Y t - Y t \ 2 + E \ [M - Z r dB r } T - [M - jf Z r dB r ]ij = 0. 
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Proof. Let M t = J Q * Z r dB r , by the proof of Proposition 12.21 we know that M t 
is a J-'f V J-y -martingale. 

From Ito's formula and Proposition 13. 5\ we know that 

E\Y t - Y t \ 2 + E ([M - M] T - [M - M] t ) 
= 2E J (f(s, Y a , a.) - f(s, Y s , a,)) (Y s - Y s )ds 

< CE J t \Y S -Y s \ 2 ds. 

From Gronwall's lemma, we obtain E\Y t — Y t \ 2 = 0, Vt G [0, T] — D, and the 
result follows. □ 



We come back to finish the Proof of Theorem 3.1: 

Since Y is continuous, Y is cadlag, and D is countable, we get Y t = Y t , 
P— a.s., Vt e [0,r]. Moreover, we can deduce that M = M. Hence, we get 
the result that the sequence (Y t £ , f Q Z £ s dB s ) converges in distribution to the 

process (Y t , J Q * Z s dB s ), and the proof of Theorem 13.11 is completed. □ 
3.3. Examples 

Example 3.1. Consider the case that Q is weakly irreducible with the state 
space M. = {1, • • • , m} and v = (z/l, • • • , is m ) is the quasi stationary distribu- 
tion, then a £ can be considered as a fast-varying noise process. As shown in 
the following, the noise is averaged out with respect to the quasi stationary 
distribution. In this case, the corresponding BSDE is 

Y £ = i + ^ f(s, y/, al)ds - ^ Z £ dB s . (12) 

Under Assumption \2.1\ and Assumption \3.1l from Theorem \3.1\ as e — > 0, the 

sequence of process (Yf, f Z e s dB s ) converges in distribution to the process 
(Yt, Jq Z s dB s ), where (Y, Z) is the unique solution to the following BSDE 

Y t = i+ ^2uif(s,Y a ,i)ds- Z s dB s . (13) 
Jt i=1 Jt 

It is noted that the generator of BSDE [13]) depends on the quasi stationary 
distribution of the Markov chain. Thus we can adopt the distribution of aTf- 
adapted process Y , the solution of BSDE (TIB"]) , as the asymptotic distribution 
for the solution of Tf V J 7 "^- adapted process Y e . 
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In practical systems, the small parameter e is just a fixed parameter and it 
separates different scales in the sense of order of magnitude in the generator. 
It does not need to tend to 0. We give a detailed example for interpretation. 

Example 3.2. Suppose the generator of the continuous-time Markov chain 

(-22 20 2 \ 

affected BSDE (J3]) is Q — I 41 —42 1 , and the corresponding state 

\ 1 2 -3j 

space is Ai = {s\, s 2 , S3} . It is obvious that the transition rate between si 
and S2 is larger than the transition rate between S3 and other states, i.e., the 
jumps between s\ and S2 are more frequent than jumps between S3 and other 
states. We can rewrite Q as following 

Q = t^Q + Q 





1 


o\ 




{> 


-2 





l+( 


V 





0) 






0.05" " 0.05 



It is noted that we choose suitable e to guarantee that Q and Q to be the 
generator with the same order of magnitude. 

Now, we introduce the continuous-time e-dependent singularly perturbed 

Markov chain a 6 = {af; < t < T} which have the generator Q £ = -Q+Q = 

2 

1 I , and define the aggregated process 







1 






-A 




-2 





H 




\ 





oy 






-3, 

a £ = {a £ t ; < t < T} 



1, a\ E {s 1 ,s 2 } 

2, of G {s 3 } 



Proposition ^. II yields that a 6 converges in distribution to a continuous-time 

(-- ~ \ 

Markov chain a generated by Q = I ^ 3 3 ^ j . By Theorem \3.1\ we can 
adopt the probability distribution of the solution to the following BSDE 



Y t = £ + J f(s,Y 8 ,a 8 )ds- J Z s dB, 



as an asymptotic probability distribution of the solution to the original BSDE. 

-21 
Here f(t, y, 1) = -f(t, y, s x ) + -f{t, y, s 2 ) and f(t, y, 2) = f(t, y, s 3 ). 
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Since the limit averaged Markov chain has two states and the original 
one has three states, we have reduced the complexity of the model. This 
advantage will be more clear when the state space of the original Markov 
chain is sufficiently larger. 

4. Homogenization of One System of PDEs 

As an application of our results in previous section, we show the ho- 
mogenization of a sequence of semi-linear backward PDE with a singularly 
perturbed Markov chain. In this section, after showing the relation between 
BSDEs with Markov chain and one system of semi-linear PDE with Markov 
chain, we derive the homogenization property of backward PDE with a sin- 
gularly perturbed Markov chain based on the weak convergence of the asso- 
ciated BSDE. 

Here, we give some notations as follows: C k (R p ; R q ) is the space of func- 
tions of class C k from R p to R q , C k b (R p ; R q ) is the space of functions of class 
C k whose partial derivatives of order less than or equal to k are bounded, 
and Cp(R p ; R q ) is the space of functions of class C k which, together with all 
their partial derivatives of order less than or equal to k, grow at most like a 
polynomial function of the variable x at infinity. 

4-1. Relation between BSDEs with Markov chains and semi-linear PDEs sys- 
tems with Markov chains 

For t G [0, T], consider the following semi-linear backward PDE with a 
Markov chain: 



u(t, x) = h(x) + / (£w(r, x) + f(r, x, u(r, x), (Vwcr)(r, x), a r )) dr, (14) 



Assumption 4.1. b G Cf b {R m ;R m ), a G Cf^R 171 ; R mxd ) , h G C*{R m ;R k ). 
For f : [0,T] x R rn x R k x R kxd x M ->■ R k ,\s G [0,T] ; i G M, (x,y,z) ->■ 
f(s, x, y, z, i) is of class C 3 . 






Firstly, we make the following assumption: 
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Moreover, f(s, •, 0, 0, i) G Cp(R m ; R k ), and the first order partial deriva- 
tives in y and z are bounded on [0,T] x R m x R k x R kxd x M., as well as 
their derivatives of order one and two with respect to x, y, z. 

Definition 4.1. A classical solution of PDE (1141) is a R k -valued stochastic 
process {u(t,x); < t < T,x G R m } which is in C°- 2 ([0,T] x R m ; R k ) and 
satisfies that u(t,x) is -measurable. 

V£ G [0, T], x G R m , we introduce the following FBSDE with a Markov 
chain on [t, T\. 

PS PS 

X t s > x = x + J b(X t r > x )dr + J a{Xl' x )dB T1 (15) 

= h(X!f) + J f{r,X\: x X' x ,Zr X ^ r )dr- J Z l /dB r . (16) 

The aim of this subsection is to show that, under above assumptions, the 
FBSDE (TT5l) - (TT^l) provides both a probabilistic representation and the unique 
classical solution for PDE (1141) . 

For SDE (fT5l) . it is well known that under Assumption 14.11 h has a unique 
solution {Xl ,x ] t < s < T} which has a version that is a.s. of class C 2 in x, the 
function and its derivatives are a.s. jointly continuous in (£, s, x). Moreover, 

sup | + iVXfl + \D 2 X t s ' x \) G Pi L p (R),V(t,x) e [0,T] x R m 

t<s< T ^; 

where VX*' X , D 2 X t s ,x denote respectively the matrix of first order and second 
order derivatives of Xl' x with respect to x. 

For BSDE (fT5|) . denote f(s,y,z,i) = f(s,X^ x ,y,z,i), V? G .M, we know 
that / satisfies Assumption 12.11 since / satisfies Assumption 14.11 So there 
exists a unique solution pair {(Y*> x , Zf)\ t < s < T} to BSDE ([TBI 

Define X*' 1 = X*£, = and Z l f = 0, for s < t. Then (X, Y, Z) = 
(X^,y^,Z^) is defined on (s,t) G [0,T] 2 . 

Theorem 4.1. Under Assumption ^ . 1\ let {u(t,x);0 <t<T,xE R m } be a 
classical solution of PDE p^l )- Suppose that there exists a constant C such 
that, 

\u(t,x)\ + \d x u(t,x)a(t,x)\<C(l + \x\), V(t, x) G [0, T] x R m , (17) 

i/ien {Y l s ' x = u{t, X l s ' x ), Z l s ' x = d x u(t, Xl' x )a{t, X$ x ); t < s < T) is the unique 
solution of BSDE (Tj6j). Here {X l f- 1 < s < T) is the solution to SDE (TJ0 
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Proof: Vt < s < T, let s = t < t x < t 2 < ■ ■ ■ < t n = T, with Ito's formula 
and PDE (JUJ, we get 

Yf - h(X^) 
= u(s, x) — u(T, X^ x ) 

n-l 



i=0 

n—1 n— 1 



i=0 i=0 

n-l 



/ /-ti+l 

i=o V J * 

+ {£u(s,Xlf +i ) + fis^X^u^XlfJ, (Vua)(s,X}? +l ),a s )) ds^ 



17)1 yields that 



r-T 

£( sup |w(t,X*' x )| 2 + / \d x ua(s,Xl' x )\ 2 ds ) < oo, 
and the adaptability is obvious. The result is followed as A = sup \t i+1 — 

0<i<n-l 

*i|-»0. □ 
Now we deduce the converse side of Theorem 14. 1[ 

Theorem 4.2. Assume that for some p > 2, E\£\ p + E \f(t, 0, 0, a t )\ p dt < 
oo, let b, a, f, h, a satisfy Assumption ^ -1\ then the process {u(t, x) = Y^' x ; < 
t <T,x G R m } is the unique classical solution to PDE fli^p . 

As preliminaries for the proof, we give two propositions about the regu- 
larity of the solution of BSDE ( II 6p whose proofs are put in the Appendix. 

Proposition 4.1. Under the assumption of Theorem {Yg' x ;(s,t) G 
[0, T] 2 , x G R m } has a version whose trajectories belong to C°'°' 2 ([0, T] 2 xR m ). 
Hence Vt G [0, T], x -> is of class C 2 a.s.. 

Proposition 4.2. Under the assumption of Theorem {Zl ,x ', (s,t) G 
[0,T] 2 ,x G R m } has an a.s. continuous version which is given by Z l s ,x = 
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VY^ x {VXl' x )- 1 a{X t f). In particular, Z\' x = VY^ x a(x). Here (yY*' x = 
QY l ' x dZ t,x \ 

— — 2 — , V 'Z t,x = s ) is the unique solution of 
ox ox J 

VY? =ti{x¥)VX¥ + f (£(r, X?, Y^, Zf, a r )VX^ x + ffa, Xf, 

J s 

Y*' x , Zjf, a T )VY^ x + f' z {r, X f r ' x , Y*' x , Z l f , a r )VZ l /)dr - ^ Z l ; x dB T 

Proof of Theorem 14. 21 Let t = t < t x < ■ ■ ■ < t n = T, we have 

h(x) — u(t, x) 
= u(T, x) — u(t, x) 

n-l 

=y^(tt(ti+i,g) -u{t h x)) 



i=0 
n-l 



(«(*t+l, x) - u(t i+1 , + - x)) • 



i=0 



r t.A ,X 



Since u{U + \, X^fJ = Y t ' h+1 = Y^ x , we obtain the following from BSDE 

(USD 

u(t i+1 ,Xli^) -u(U,x) 

-yti,x \/-ti,x 

— 1 U+i *ti 

= - f{r ) X t - x X 1 ' x ,Z t - x 1 a r )dr+ f ^ Z^dB r . 
It is known that u(t, •) e C 2 (R m ) from Proposition 14.11 Then, with Ito's 
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formula, we get 

h(x) — u(t, x) 



W Cu(t i+x ,X**)dT- r + \vua)(t i+1 ,X^)dB, 
1+1 f{r, X' r r x , Y r u ' x , Z?' x , a r )dr+ [ * + ' Z\: x dB. 



£ / (£u(t i+1 ,X^) + f(r,X^,Y r t '' x ,Z t r '' x ,Ur))dr 



From Proposition 14. II and Proposition 14.21 letting A = sup |£j+i — M ~~ ^ 0, 

0<i<n-l 

we have 

n(£, x) = + / (Cu(r, x) + f(r, x, u(r, x), (Vwcr)(r, x), a r )) dr, 

here u G C 0,2 ([0,T] x R m ;R k ). The uniqueness property is followed from 
Theorem 14. II and the uniqueness of the solution of BSDE (TTB|) . □ 

4-2. Homogenization of PDEs system with a singularly perturbed Markov 
chain 

Now we can give the application of our theoretical result in previous 
section (Theorem 3.1): homogenization of PDEs system with a singularly 
perturbed Markov chain. 

Consider the following sequence of semi-linear backward PDE with a sin- 
gularly perturbed Markov chain, indexed by e > 0, for t G [0, T], x G R m , 

f T 

u £ (t, x) = h(x) + / (Cu £ (r,x) + f(r,x,u £ (r,x),a £ r ))dr, (18) 



Here a 6 is the singularly perturbed Markov chain which is stated in subsection 
13.11 We have the following homogenization result. 

Theorem 4.3. Under Assumption \3.1\ and Assumption J^.l, PDE ffigj) has 

a classical solution {u £ (t,x);0 < t < T,x G R m }. As e — > 0, the sequence 
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of u £ converges in distribution to a process u, where u(t, x) is the classical 
solution of the following PDE with the limit averaged Markov chain a 



u 



(t,x) = h(x) + / (£n(r, x) + f(r, x, u(r, x), a r )) dr, 0<t<T. (19) 



rrii 

Here f is the average of f defined as f(t,x,u,i) = u jf(t, %, Sjj), for 

3=1 

i e M = {1, • ■ ■ ,1}. 

Proof. From Theorem 14. 2\ we know that {u £ (t, x) = Y t e ' t,x ;0 < t < T,x G 
R m } is the unique classical solution of PDE ( TT8l) where {Y s £ ^ x ; t < s < T} 
satisfies 



Y s £ ^ x = h(X^ x ) + f f{r, X^, Y £ ^ x , a £ )dr - j Z £ /> x dB r 

J s J s 



(20) 



and {Xl' x ; t < s < T} satisfies SDE flT5]). V(t, x) G [0, T] x R m , from Theorem 
13.11 we obtain that Y t £,t ' x converges in distribution to Y^ x as e — > where 
{Y*' x ;t < s<T} satisfies 



Y*' x = h(X^ x ) + J f{rXr X X' x ^r)dr- J ZfdBr, (21) 

Again from Theorem 14.21 we know that u(t,x) = Y^' x is the unique classical 
solution to PDE (119]) . and the results are followed. □ 



5. Conclusion 



In this paper, stemmed from the adjoint equation for deriving the optimal 
control of stochastic LQ control problem with Markovian jumps, we study the 
solvability of one kind of BSDE with the generator depending on a Markov 
switching. Then, we consider the case that the Markov chain has a large 
state space. To reduce the complexity, we adopt a hierarchical approach and 
study the asymptotic property of BSDE with a singularly perturbed Markov 
chain. Also, as an application, we present the homogenization property of 
one system of PDE with a singularly perturbed Markov chain. 

It is noted that in this paper, we only give the homogenization result of 
PDEs system with Markov chains when there exists classical solution under 
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smooth assumptions. In the successive work, we will study the Sobolev space 
weak solution for the related PDEs system and homogenization problem 
by virtue of BSDEs with Markov chain. Some applications of this kind of 
BSDEs in optimal control and mathematics financial problems would also be 
interesting to investigate in our future research. 
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Appendix A. Proof of Proposition 14.11 and Proposition 14.21 



The proof of Prop osition 14. II and Proposition 14. 21 follow a classic approach 
as shown in 18|, |l9). Here, we will give a sketch of the proof. Firstly, we 
present a higher order moment estimation to the solution of BSDE 

Corollary Appendix A.l. Assume that for some p > 2, E\£\ p +E J Q T \ f(t, 0, 
0,a t )\ p dt < oo, under Assumption \2.1\ we have the following estimation for 
BSDE (TJ ; 

E ( sup \Y S \ P + ( f Z 2 s ds)*\ < oo, V0 < t < T. 

\0<s<t Jo J 

Proof. Applying Ito's formula to \Y t \ p from t to T, we can get 



, , Pip- 1) rl 



\Y t \ p + 



YJ p - 2 \ZJ 2 ds 



\Z\ P +P f \Y s \ p - 2 YJ(s, Y„ Z 8 , a s )ds -p f \Y s \ p - 2 Y s Z s dB s 
Jt Jt 



By the same technique as that in Lemma 2.1 of Pardoux and Peng [18 
obtain that 



we 



E\Y t \p + p{p : l) E 



\Y\ p - 2 \ZJ 2 ds 



< E\C\ P + P E ^ \Y s \ p - 2 YJ(s, Y s , Z s , a s )ds. 
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From Assumption 12.11 using Holder and Young's inequalities, there exist 
K > and C such that 

rT 

E\Y t \ p + KE I \Y s \ p - 2 \Z s \ 2 ds 



< E\i\" + CE ^ (\Y s \ p +\f( S ,0,O ias )\ p )ds. 



It follows from Gronwall's lemma that 

r-T 



0<t<T 

Since 



sup E\Y t \ p + E [ \Y t \ p - 2 \Z t \ 2 dt < oo. 

<t<T Jo 



\Y t \ p < |d p + P f \Y s \ p - 2 Y s f(s, Y s , Z s , a s )ds -p£ \Y s \ p - 2 Y s Z s dB s , 

Burkholder-Davis-Gundy inequality yields that E(sup 0<t<T \Y t \ p ) < oo. 
Now we prove E(f Q t Z 2 ds)i < oo. Since 

/ Z s dB s = Y t -Y Q + f f(s,Y s ,Z s ,a s )ds, 
Jo Jo 

sup I / Z s dB s \ < 2 sup \Y t \+ I \f(s,Y s ,Z s ,a s )\ds, 

0<t<T Jo 0<t<T Jo 

the result is followed from Assumption 12.11 and Burkholder-Davis-Gundy in- 
equality. □ 



Lemma Appendix A.l. (Lemma 2.7 in flM]) For any p > 2, there exists 
a constant c p such that for any t,t' G [0, T\, x,x' G R m , i G {1, • • • ,d}, 
h, h! G R\{0}, 

E{ sup \X l f\ p ) < cp(l + \x\ p ), 

0<s<T 

E{ sup \X l f - X^ x '\ p ) < Cp(l + \x\ p )(\x - x'\ p + \t- t'\2), 

0<s<T 

E( sup \A\Xjr\ p ) < c P , 

0<s<T 

E{ sup |A^A*' X - Ai,X*' x '\ p ) < cp(\x - x'\ p + \h- h'\ p + \t - t'\i). 

0<s<T 



g(x -\- he<i) — Q\X\ 

Here A l h g(x) = ^ , 1 < i < d, where e, denotes the ith vector 

of an arbitrary orthonormal basis of R m . 
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Proof of Proposition I4.lt Since 



E( sup \Xl' x | p ) <c p (l + \x\ p ), 

0<s<T 



from the proof of Corollary Appendix A.l Vp > 2, there exist C p and q such 
that 

E ( sup \Y^ X \ P + ( [ \Zl' x \ 2 ds)i) < C p (l + \x\ q ). 

\0<s<t Jo J 

Note that for t V tf < s < T 

sy-t,x -yt' ,x' 

s s 

= (^J ti{X¥ + \(X^ X - Xp x '))d\^ (X^f - Xp x ') 

+ [ [ {f' x {^'' X '^ r ){Xr - Xt' x ') + f'&f > x \ a r )(Y r ^ x - Y*' ,x ') 
+ f'^f'^a^Z^ - Z**)\ dXdr - J\zl: x - Z^ x ')dB r , 

(/ y^^' x ' \ / v'- 1 ' \'l'..r'\ \ "/'..r' \ t\'l.,r X .'/'..c' \ -7 

A(Z*' Z Since 



where Eff = (r, X?' x ' + A(Xf - X*'' 1 '), l?''*' + - V, 1 ■ r ).Z i r ' + 



E{ sup \X\' X - X*> x '\ p ) < c p (l + \x\ p )(\x - x'\ p + \t- t'\2), 

0<s<T 



combing with the proof of Corollary Appendix A.l we can deduce that 
Vp > 2, there exist C p and q such that 



E ( sup \Y^ X -Y^ x '\ p 

0<s<T 



\ Z t,x_ Z t,x |2 rfs 



< C p (l + \x\ q ){\x - x'\ p + \t-t'\2). 

Then using Kolmogorov's lemma, we know that {Y^' x ; (s,t) G [0,T] 2 ,x G 
R m } has an a.s. continuous version. 
Next, we have 

A\Y**= ^ h'iX 1 / + XhAlX t /)AlX t T x d\+ f !\f'Mf .«r)AW 

+ yj(e^* + f'Mf, a r )l\\Z^)d\dr - J A\Z^ x dB T 
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where Q^ h = (r, X** + AftA^*, Y$> x + XhA{Y r ^ x , + XhA\Z^ x ). 
Since for each p > 2, there exists c p such that 



£( sup \A\Xf\') < c p . 

0<s<T 



We can have the following estimation 



E ( sup \AiY*' x \ p + ( / \AiZi'*\ds)A < c p (l + \x\ q + \h\ q ). 

\t<s<T Jt J 



Then we consider 
A\Y^ X - Al,Yf 



= f h\X^ x + XhAlX^AlX^dX - f h\Xp x ' + XhAi,Xp x ')Ai,Xp x 'd\ 
Jo Jo 



'0 



+ 
+ 



/ l (/;(©S' fc ,«r)A^-/;(0t;f' /l ',a r )Aj l ,F/^)^r 

- ^{A\Z\: X - A\,Z ti /)dB r . 
It is noted that 

£( sup |A^*' X - A^,Xf y | p ) < cp(|x - x'| p + | ft - fc'| p + \t - t'\*). 

0<s<T 

Vi <E M, using similar arguments, we can show that 

E ( sup \A)tf* - A\,Yf*\> +( [ T \A\Zf - Ai,Zt> x '\ 2 ds) 

\0<s<T \JtAt> J 

< c p (l + \x\ q + \x'\ q + \h\ q + \h'\ q ) X (\x - x'\ p + \h- h'\ P + \t- t'\ *). 

The existence of a continuous derivative of Y*' x with respect to x, and a 
mean-square derivative of Z l s ' x with respect to x follow from this estimation. 
And the existence of a continuous second derivative of Y* ,x with respect to x 
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can be proved in a similar scheme. Using similar arguments as in the proof 
of Theorem 2.9 in (Q, we can show that {Y*> x ; (s,t) G [0,T} 2 ,x G FT} has 
an a.s. continuous version. □ 

Proof of Proposition 14. 21 For any random variable F of the form F = 
f(ip, Bih), • ■ ■ , B(h n )) with / G C™(R n ), if G L% , h x , ■ ■ • , h n G L5- (0, T; R d ) 



and = J T Zii^dBt, where 7i = F t a T VF t B , let D t F = ^ fl(B(h l} , ■■■ . 



B(h n ))hi(t), < t < T. For such F, we define its norm as 
||F|| lj2 = (e (f 2 + [ \D t F\ 2 dt 



8=1 



Denote 5 as the set of random variables of the above form, we can define 
sobolev space: D 1 ' 2 = iS"" 12 . Using the same argument in Proposition 2.3 in 
(l9| . we can obtain the result. □ 
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